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Personalized s|^stems^f inst^.uction <P3I) , also 
caJ.T.ed individualized instruction or contingency7Jtfanaged instruction, 
were.dev'lioped in the mid--1960s at the college level l)y Fred Keller, 
a reiiif orcement. learning theorist, The^^ Keller plan •consists of 'five 
features: self -pacing, unit mastery, student tutors, optional 
motivational lectures,^ and learning froja written material* The Keller 
plan appears to wbrk Weil because it is Consistent w4.th at least ten 
educational pfinc.ip^les for which there is, some ejETpirical support^ , ' 
'such as active res-p*6ndihg and* specification of objec^ves.* Keller •s 
plan may be implemented in five, stages^ assei5^ing entering behaviors, 
specification of course objectives> selecting resources and 1 • 
activities, ^ €fs±ablishing the course, .and evaluating >student 
perf ormanc^^\ Systematic efforts at evaluating PSI are beginning to 
appear. The two AmostVfextensive ^valuations show -that fSI students 
perform better on all types of examinations, have longer retention, 
ajid *have more, positive attitudes towards courses than students taking' 
conventional, Structurfe-type courses, (Author/Npy-- ^ * • 
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.\ . ABSTRACT, • . v 
1 PERSONALIZED SYSTEMS OF INSTRUCTION 



\ ^ ' * \ ' . Dickinson McGaw 

Arizona Stiate University 

Dr. \ Fred Keller,, a reinforcement learning theorist, first introduced the 
Keller Plan, or What is also called PSI (Personalized Systems of Instruction) 
" in t\ie mid-1960* s. 'The k^ler plan consl^sts of fivp f^atur€is-r self-pacing, ^ 
unit, mastery, student tutdr^, option^ motivational lectures, *and learning/ ' 
from written materia}. ' The, Keller Plan appears to work wel^i because ±p^±s 
consistent with at least ten edupatignal ^)rinciples for whi^^li there^ is some 
empirical support : active respoi^dingV positive condition^ ^d consequences , * 
specification of objectives^,;, organization of material, mas tefcy before advance- 
ment, evaluation/bbjcc.tives congruence, freqilfent evaluation ,\immediate feedback 
selft-pacing^ and personalization; , • V* 

The Keller Plan may be Implemented in fiv€ stages: assessing '^fentering • 
behaviors, spfedification of co^!ii|se bbjectives, selecting resources and 
- activities, establishing the course, and evaluating student performance. 

Systematic efforts at evaluating 'PSI have only begun to appear in professional 
journals. The two most extensive 'evaluations report that fSI students 
perform better on all .types of lexaminations, have longer reten^tion, ^d have* 
t mdre positive attitudes towards the course than Students taking conventional 



structure type courses. 



' ^ ^ PERSONALIZED SYSTEMS OF' INSTRUOTION 

: . . , '^Dickinson McGaw ' ^ 

^ Ari25ona State Uhive'rsity 

> ' ^ INTRODUCTION 

Personalized j^stems of instruotion (PSI), also called indivl4uali2ed 
liM5t3fuction or contingency managed, instruction, were develgpqd' in* the mid- 
1960's at the college level by Fred Keller, a reinforcement thebiy psycholo- 
gist. Keller states that five features distinguish PSI from conventional 
lecture-type courses (Keller, 1968). First, instruction is presented 
prinrndly in written form. Second, lectures are used for motivational 
pui^ses only. Tiiird,; student progress in the couyse is self -paced. Fourth, 
stui^ent mastery of the uniti of the coiarse is required. 'Fiftk, ^student-tutots 
8el<^cted from previous clas^'i^s are used to assist the students. 

/ llfeny college courses now include most oritEe f eat tires" bl^SI. Instruction 

In tneise courses may coiisist of a number of small, units- of toitten material. 

\ 

A student may progress through the units at his^own pace. However,' a^ student 

imist demonstrate that he has mastered the material in one tinit before he may 

. ' , , ^ " \ ' " ^ 

proceed to the nex^unit. Shcjci^g^^zzeQjtre used -to assess student mastery 



of ^ the material in ejach uiait. Student- tutors coiSeijV-Quizzes and^reView 
quiz questions with the student, If a studeanit'fr performance on a quiz / 
indicajbes that he has not mastered the ^unit mfiterialdj the ^student must^take 
the quiz or ari* equivalent form unt^l he has demonstrated lyastery. A^udent's 
\^l3kl grade inr-the course is usually kepe|!jclent,oni^thiB number of uni^s madter6dj 
and in/ some cases > on performance 6n one or more comprehensive examinations 



covfering several units. 



\ 
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PSl POSTUUTES 



A 




' ' ' * 

Personalifijed systems of ^jistruction are based \ipon a number of 'assunip- 

■ ; .... , % ^T.^/-— - • _ . • 

tions- concerning how students learn most effectively. i U,though .the findings 
Sri^hot concluaive, educational research seems to support the following 
hypotheses vipon 4hich PSI is based ' (see Carr, 1962; Keller > 1%7; Ma^er, 
1968; and Kemp, .1^71). " / • 

1. Active responfling^ Learning iiflproves if the student is engaged actively 
%jthe sift)i|ect matter and if the student actively res'jKmds to the 

subject matter. > ' . ' 

2. Posifive conditions and consequences . Learning improves if, whenever 

the student ip responding to" the subject matter, he is also in the \ 

^ ' ' ' \ 
presence of pbsitlye conditibn^B and consequences* The Inore positive 

the 'consequences for the* student, the more likely he is to. learor 

J. , Specification of objectives . Learning improves If the stud^t knows. 

precisely \irtiat learning . dlitcojnes are desired and reiiiforced by the* . 

I - (9 

instruc, 

4. ^ O ^ahi^atlon material s Learning im|)roveS if the subject matter 4^ 

well-*oteahi25ed afid pf Rented In relatively \small units of infoxBiation. . 

5. Ifastery before advancement • Learning improves if .the mastery of mterial^ 
is required before advancwtog. to new material. . ^ . '* 

^^uation/objectives c^bngr^nc J • Learning in5>i;oveS' *jff the evaluation of. 
the stiident's performance isvcflp with the 'specification. of 

objectives* given the student. ' ^ ^' - ' 



X 



7. Frequent evaluation . Learning Improves as the frequency - of e^aluation^ or - ^ 
f^eedback -increases. Iieamlng,is more effective if it is spacea tbroug^Out^ ^ 
the semester rather than mfissed at- the time of a. ^in^l examination. 



• ^. . t '■• '''' 
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8* Iianec^ate feedb9>ck >. learning improves if the student -is given inanediap 

- * \ \ • ' T 

knowledge of the results of his performance. ) As time passes between the 



• ^perf9.rmance and the feedb 
and learns incorrect info 
9. Self^pacing ; Learning 



;the at^aenL -J^es ii^teri^st in the res\a*s 
tion. ' V 

bves if each student can proceed through the 
. .material at a spee^ commensurate wi^^hhis^ ability and other demands 
upon his tim^J 

improves as 'the^^&tti36ni eljcperiences increased 
utor. . / ^ '' 



10. Personalization.^ 



interaction with his instructor or 




IMPISMENTING A PSI COURSE 



/tbr the last five years, ./this 
Obiversity in the develo|5ment' of a 



writer has participated at Arissona State 
'PSI course incorporating^ the above, 
principles. The coxirse is^a required introductory but* comprehensive 
overv|.ew of/ social^ science /r^searoh methods (McGawtod VVatfeon, 1976).' I ^ey^ 
shall now/descitibe how instructors can estay 
(Watson^nd McGaw, l!l975)^ 




\ own PSI course 



Therg^r^ive identifiable st^es in the implementation of a PSI 



Ifeller P^an model: 1) assessing er^^ering- behaviors; 2) specifying |^ ^ 
jObjectives; 3) selecting reso'urces^^d activities; 4) establishing^ aim 
implementing the course framework; and 5) evaluating student perfoji^nance. 



ASSESSING ENTERING BEHAVIORS 

The, attempt or need to asse'^s 'the behaviors, of students'^ eilterlh| a; 
^course is not piique to^^PSI. In almost any course, it is beneficial, for , 
the' Instructor to know about the ne.ed[^ goals, characteristics, and* capabi* 
11 ties of the students who will* take thjj bourse. This becomes eveil'mqte 
important for a PSI coui;se, in- which a^/ effort is made to individi^allizk 



I; 



course material and instruction to eacjh ^tudenVs ^^ituationi . 



a^wo of the most common, but unreliable, techniques of g?itheilng this 
initial infprmation are intuition and impression. Three '"somewhat, reliable 



. jnethods commonly are -used in assessing entering behaviors. Fir3t, some ^^ 

instructors design ^^d administer -pre-tests on tHe information covered in 

t 4^ . »* — — , I 

tiie course or 'in particiHar units to d'eteikine the amount of pre-'existlng 

TS^Bt&ry^o^ thQ^^urpe material; This technique can^^^e^sed to;; place a stufient 

Nat a pairt^cular point \7ithin the -'sequence of material cohered in/the course.^, j 

Simultaneous questioimaires can gather other ^information on the students 

•\mfela-6ed to mastery 'of ^urse content. A'se^^d^edinique of .assessing 

ent&ring behaviors involves the acquisition^ of such available data^s test 

scorea, grades, and transcripts that provide some insight .to thfe student's 

academic skills. * Finally, the instructor' can schedule/ conferences vdth each 

student in Order to determine hi^> lQvel and kinel of motivation, _ hone and 

tiork environment, self -concept/ and 6m(?unt.^f pre-existing knowledge <if the • 

course content area. . , 

'. ■ ^ ' ^ . 

SPECIFICATION OF OBJECTIVES * . r - 

The spefiification of course -and uMt instructional obJectivesHs a key 

• ■ ' • ' ' • ? • I v'v- 
element of systematic instruction. M instructional objective is a stjateme^t ; . 

• ~" J. ' '■ . ' : 7 • . 

that Idwitifies a learning outcome intended by the course instruc-t|)r (GronlUnd, 

^ i970:.l). If 4n instructor is able to define precisely wh^ outcomes ;or 

Student behaviors^he expects a^ a result of his' course and if hk can^ecify 

them in terjnfl»/of stated objectiyfes, then several beneflcic^l consequences ^ 



/ 



follow (Gronlund, 1970:* 4)'. • First,- the inst"ructor has clarified for himself?,^ 

and hfs students precisely what students ^in -ftie couyse ape expected -to^ do.. ' * ^ 

■ . i ' . ' . , . * ' ♦ * ' ' ' ? \ i „ . ' 

^'Second, students are able to rely .911 the objectivesSM- ^des^^^^^ 

their study^efforts. * Third/ the objecrtiVes gx^Se/the tastructo^;in/the - / 4^ 
selec1*m*of «o^8«umatesi4La^.„teafi^^ 

♦ ' ' ' / i . 
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covered. Finally, objectives also serve as a useful gufde in the creation 6t 
evaluation ♦-Instruments to measure^ the fulfillment of the objectives. 

The use of instanxctibnal objectives is facil;Ltated by the use of 
educational taxonomies (^oom, et, al/, 1956; Krathwohl, et^/al. , 1964). 
The widely accepted divis^pn of the taxonony of educational objectives into 
the cognitive, affective, and psychomotor domains^ssists an instructor in, 
identifying the learriing outcomes , he desires for his course. The cognitive 
domain includes Knowledge, comprehension, application, analysis, synthesis, 
and evaluation as cognitive or intellectual skills. ^ The affective domain 
relates, to feelings and emotions, such as: receiving, responding, valuing, 
organizing^ values, and refers to actual phj^sical skills, such as typing, 
operating a' keypunch oi^calculator, or other physical operatiox^s. 

Objectives f dr .any one coxirse may cover^all levels of any, or all, of^ 

the taxonomic domains. " JA>reover, the use of objectives does « not limit the 

• « ' • . J, 

instructor to the specification of .only ohserv^able behavior^* The student can 

be asked to feel^ to create, to appreciate, to imagine, as well as to recall, 

to .calculate, to explain, to analyze, .and tQ evaluate. It is likely , ^ however, 

that most instructors will prefer to ba^fe an evaluation of each student on 

the basis of some observable behaviors or performances.^ This does hot mean 

that other objectives c9jinot be stated, but it is' incumbent. uj)on the instr^tor* 

to -specify which objectives r/ill be evaluated. " Then, hoth instructor and 

studfent will know the specif ^c Jeajming gutcomes* for'vi^hich students Wiil be 

held accountable. - . ' . '^ 

. ; . ^ ' 

SELECTING RESOURCES AND ACTIVMJES ; , / ^ ^ 

Resources and- activities must be selected 'on the basis of the course 
objectives and the assessment of^ entering behaviors. ( Some tirifes the lack • 
of proper resources requires, the restatement of objectives in order that ^ t 



0O0Q8 ; 



the objectives and course materials are consistent with eScb ot]ter.)/ In 
general,«^the PSI instructor must decide which objec-^ives can be learhed 
most effectively by the learner on his own, through group interaction, ^ by 
formal presentation, or^with individual tutoring. PSI normally. ca^ take full 
advantage of the wide tange of resources and activities that are increasingi^- 
availabU'to ihstructors (klsorf and..Topti, 1972 : 43-60). since 
students diffef a great deal in their responses to learning envirpraients, 
PSI-prombt^ the flexibility of varying the resources and activities fp-r 

individual students. , , 

In a self -paced PSi format; the utilization and selection ^ of ^.resourcesj 

is consplicatfed somevtoat the fact that.students are spread -out along the 
sebueuce a>f material in the, coiirse. The use df materials and techniques 
desifened for use in' groups are less easily in^Jlemented. » Certain relsources, * 
s^ch as fijffis or speakers, often cannot 'be retained indefinitely while the ^ 
students progress individually' to that point in the course. Creation of 
learning resource centers has assisted somewhat in providing the capability 
to retain such resources o^er long periods of time/ Activities requiring 
group Interact-ipn may necessitate Some compromis^ of complete self -pacing 
in 5rder to accumulate enough students at the aame point, in the progression 

■ ° ■"• ;/ 

sequenxie to ^engage in the interaction. - A facior that c^iplicates the selection 
of leading resources in a self -paced format/is the fact that much of the 
initial understanding of the material by the students comes froui their own 
reading of tfi^ resource material. The type of materials that are most 
effective in such a PSI instructional , format are those that are consistent 
with the PSI bdstulates listed earlier. Especially appropriate are those* 
materials that maife xise of objectives, that divide the material dnto relatively 
smigill chunks or units, that promote active responding in the students, and that 
provide tmmedlate "feedback' tq the. student on the appropriateness of his ..response 
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ESTABLISHING AND IMPLEMENTING THE COURSE , " ' ■ i 

The' variety/ of PSI coxarses probabl^ is limited pnO^ by the number of • 
such- course that are of fered.^ Even W own PSI system varies according ..to 
• the nature of the bourse, each of us is teaching. ' We present here a PSI • 
^ format that contains as its ^in features a system of" eelC-pacing, student 
tutors, . and maetery before advancement^ It 'is patterned after tHe^^ller^ 
Plan. The cojL of the ijnstructional sequence for this- particule^ format "is • 
presented in Figure ly 

The prop'edure J?or masteri3?g each unit begins, with the student's expo- 

sure to the material. We have discussed already th4 variety of materials 

/ I * - . 

that might be employed, but more often than not^ printed materials form the - 

major source off InfoaMnation^or the students* The -student studies the material 

' ' I / ' ' y • , > • ■ .:' c 

guided by the(pbJectiy.*B<'specified f or th^t unit. Any' questions that the 
student ca^ot resolve on his: own are handled' in a session with a tutoi**^ 
Whenever the student , feels that he can fulfill the objectives specified for 
the unit,/ he can perfgrm-the mastery check. * The mastery check is an exanaiiia^ 
tion, a or some other performance in^hich the student's mastery o'V.the 

objectives is tested. .The student who passes the raaitery check;, is permitted 
to proceed to the next vini't. 'The student who does, not pass the<^mastery check- 
receives any tutorial assistance -necessary to^e^ssist .him in understanding the 
matei^al. The mastery check la then performed again (normally a different 

/• 'c . - * "i) » 

version covering es-sentialXy the. same material). This sequence i-s repeated 
until the student passes the mastery check. , , . ' ' • 

J Although this instru;>tionar sequence forms the core bf our PSI format . 

•/ - • ' ^ . 

ihet^^are several elements in its establishment and implementation that 
/require further explanation. r • . / 
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Figure A PSI InsVructioiial Sequence 



Start . 



i 



<- Examine study the 
material for the unit 



. Seek tutorial , ^ 
assislanc.ej re-s/xudy 



material \^ 
TT^ 




Selection of. Tutors : Various techniques hav^ beeii- employed ip^the selection, 
of tutc^s for courses • :The* three major sources of tutors for an undergraduate 
course are: graduate students, students who hav.e already- take'n^the course, 
-and students currently taking the ct)urse. Although there are some merits to 
•the latter source of' student tutors (Wilson and Tolsti, 1972 t 70), .we rely 
primarily oipon students who have already completed -the course. The under- 
graduates ^o^have successfully passed the course at the "A" grade level 
appear to be Just as efCectiv^ as graduate students, and, in .facl^* often 
relate to the i^udents in'^the course better than the graduate .students, ^ 
Our selection pf a tutor is 'based on: IJ a mastery and understanding . 

^ ' * • ■■ • ' y 

' of 'the material as a student in- the course; 2) the ability to coftmvmicate 
evVectively with, others; "3) evidence* of mayrltyj reliability, and a sense 
of fairness'; and, X) enthusiasm -for the task. * We exteniTI&rmal course 
credit to our, tutors fo3i their work*.* Their primary^ duties' consist of grading 
ma^ery cHecks, and tutoring any students who need'assistakceC/ They also^ / 
perfonn admit^istrative dutiefS' attendant toi the course, silc^h as a;dm^istpiiig 
mastery checks and malting certain tnaV all exams ai!e? accounted f erf at"' the fejSd 
of the day. Since wq dc^ e^tend^ffull cburse credit to.ea^h of our tutors, we t- 
also outliiie with each one an i&divlduaLized course of study that extends his • 




education in- an area compatible^with the pontent of the. PSI ^course 

V Since *the quality of instruction iii^P^L tutorial courses ji^^ds to a 
Xarge extent on the quality of the <tutoria|, sessions, it /is .important to: 
1) select txrtore* carefully, ^according tp 'th^ criteria"" ^iated in the previous' . 
paragraph; 2)* develop in the tutors an u|ider ^tending/ of tl^ material that ' 



goes beyond that required even at iSie .,"A" level of ifiastery for the cojarse; 
• 3) secure effective tutorial behavior designed to/maximize sWd€ffi1r^uMer-r 
standing' of the material; and, 4) promo\§So»sidt^cy tod reliability 'in the 

' ■ 00012. , . ' . • 



grading and tutoring of students; In Addition 'to the careful ^sel^ct ion of 

tutors/ certain training techniques help insure the attainment^ of Ihese four 

* * . . . ^* . * ' ' • . . 

conditions/ First, during Hiheir term as ' a student, iiutors aje ^so^cialized'to 

^ the role of a tutor through thefir own* interactiqiis with tutors arid hopefully 

• *^ilv. thepin^tructor in his role, as a tutor^ J^^oreove^, tuliors receive explicit 

instijuctions^rom the instructor on^tUe fine pointy of tutoring and grading^ ' 



They.^so participate iiT^utOTial- workshop sessidhs designed ^to deepen their ^ 
's. lander standing of tliS'i course matterials and to -discuss any tutorial or^'gr^ding 

problems that have arisen. Tutors are .encouraged to ae^k assistance from ^ 

pther tutor's or the ^structor in the event of any uncertainty in the -evaluation 
,>af student responses, on the mastery" check or in the .explanation of material in 

a ^tutorial session, " Finally, the instructor is always avail.abl^ to any student t 
' who feels slighted by^the tuto3?',s grading or whcj would prefer to obtain infor-' 

; ' ' ' ' r • - - • '/ % • * ' * ' ' \ 

^ mat ion or e^dplanation ditectly from the instructor, ^ " ' . ^ 

V PSI instructors^ find, that the tutors take' their work seribusly^ ai^ ' 

\ . ' - ' ^ ^ "^fl ' ' ' :> * 

> interact well -with thef students in the course, ^liosi students seem^o'be^'moTe • v. 

// willingrio ask questions and'sfeek help^'^from the student-tutors than, from the , ^ 

regjtLariinstructor. One by-product pf^ the/tutorijar program is ^afc it ^ ^ 

provides anvincentive for students to master the objectives, so that they too^ 

■■ - . /• ' " . - ■ ^ • ■ '. 

can:^ become tutors r Mottier by-product •i's, tTia^i.tha tutors become a peer group. 

■ . . . ^ . , . t . ' ► 

oC 'ftfgHly. motivated students who ,ehipy interactiiig closely with ah instructor, y- 
The tutors' constitute an 'elite' group of- sgrlous undergraduate stvlden^rwho » 
are approaching/ a- gradualje. school* type of. experience, • - j 



•* The humbeV, of 'tutors reqiiired for a given PSI course may vary with ^he 
iLtJa'e.J^£,jjQurse."« 4vi^ the? lower- -student/tutor r^tio, the\ more' <■ ^ 

'''^\^\ ■ ' ■ -• 'T'.. ^ \ \, ■ ' ■ ' • " ' ^ " 

.personaliz6d attention, tia/ can bfe glven'to each student. A,ra%io of approii-. 

mately eight to tin- students per tiltor seems adfejuate for. most courses. Thete 



J 



also appears to be V liMt oh the -.number -of tutors that one . instr,uctor can 

supervised effectively • Each instructor probably needs to discover his own 

p " |/ ' ^ . ^ ^, • ' 

'liinit. Ouz expferidack suggests that a course which exceeds lOO students 

(19 tutors;) is prgl|ably^*too large for 'the most, effective implementation of 

our' PS J format. TUts fo||alation .Is based on cer-^in assumptions about the^' 

role oTthe instructor; which will be discussed in a subsequent section. ; - 

Physical Facilities: At'lea^t twro rooms. will be necessary for the,imple- 

— ' — ^ r . ' ' ' ' ' , 

mentation of our PSI forme^t. One room is devoted to tutorial and grading 
• sessions/ the oth^r topm is used for the* administration^ bf mastery exainina^ 
^'tions, the most Qommon'form of mastery check. ^ After r*feceiving.,apd taking 

the'l^teaciMe^^ OQP room, the student ta^es the exam to a tutor in another 

room for grading and a tutorial ses^i©iu.The us6 of two rooms, as described, 

represents a* sort of minimus^ essentials physical. space. 

Student Orientation to ^the Couii;se : While not wishing to belabor the .obvious, 

we feel coii5)elled to note the importance of the proper orientation of the 

student to PSI, In our PSI course, the students jneet together ats a class 

oj:ily one time ~ on the first day of class. This faot, as well as many other 

. §lem€*its of the PSI fonnat', may be unsettling to a number of the stiidents, who 

have been socialized to fun?tion in an educatioi^l system that^ fldnimizes 

• self-reliance, and independence. Hot ^KLyj must, students be' inf onned of the 

• * ^ • a 

full details concerning how the system operates and how to operate effectively 

within the system, 'but. a positive mental attitude 1;oward th^i course should.be 

--fostered. Consistent with tlie-.postulate that learning iniproves in the 

presence of positive conditions and -consequences, students sjjould understand 

the theory behind .the PSI .sapproach in order that porisive feelings about the ^ 

course may be generated. Students should be e'ncc^uraged to express their % 

feelings to the ^instructor, about the course at any time. We ^advise a;- series 

' :\ ■ ^- ■ ^, ■ 00014 ■ • • 
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or periodic 'consultations between pach student 'and ^the inatructor. in order to 
ffiordtor and check the academic progress and mental state of mind of the • ♦ 

student as he moves through the course.^ PSI provideia; the instructor with'^the 
' capability to^«:i|age in a much greater amount .of personal intersection with, 
^*each of hisr students than cj^ ever be the xjase in more conventional lecti:^€.and 
discussicm course formats* • ' ^ ' • • - 

The Tutorial Session ; T^Jutor^al sessienJ^^^e heaiii of our PSI format. 
It- is here that the student receives a personalized^/ attention to his needs ^a^d 
his que.stions. The tutorial s^^sion is ja ,one-to.-one encounter between student^ 
and tutor. Even thoughfmost tutors* and instructprs do not fall into the g'ame . 
class as Socrates, Such sessions often take the fonTof a Socratlc dialogue ■ 
~ in which the tutor leads the student through a cognitive restructxrcing that^ 
promotes ne^r insight and understanding! It is certainly a ijaost exciting 

educational experience for the' tutor (and instructor) to recognize that he is 

^ ' J ''' ^ ^ ' • ' > t.' ^ - ' 

a teacher; in the ,turest end finest sonce of the word. " . ' * - 



Most tutorial sec^clons t'ak^^lace ^in connec^iion with the grading of 

' 7 • . * - 

mastery checks. / This is true be<?ause most* students u^uaHy- attempt a mastery 

r ' ' ^% . ' ' 

. check on the basis of their ctm imderstejiding of the iraterial and because ^ny 

- ^ • V > ] ' 

shortfaomings in' their r^astery of the objectives will become apparent in the 

masfery check. I^thfe gradihg/tiitorial session, each student receives Immediate 

feedback concerning his responses tcTtlie masteyy check. Tutors ar0* encouraged 

, * , * . - ^ ^ ^ ^ ' . y ^ 

to probe tha student, escpci ally with respect to Responses that may- be vague, 
ambiguous, or xmreveclins about the student's understanding of .the poiht in 
question. Appropriate responses are' reinforced.. Jn the case oC-^-iafjaj^^riate 
responses, tljje tutor determines the ^basis^ for the student's response, *c6n^cts 
. any oistarofefrstanding or misini^c^^ation, ^ provides any e:q)lanations required by 
the stjiijfen'trj^and satisfies Kiinself that the student now understands the material 

7 .■» - , 
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f, ' iri question/ ""This opportunely for dialogue -permits tfte student, to e^qpiain, to 
^. elaborate, and otherwise t/ deinoastrate his mastery of the objeptives. This 

, ladds a great deal ef fleicibility' and personalization "to. the evaluation process ♦ ^ — 



5> 
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The Mastery Oieek :-' The mastery .dheek' may take any form that permits an 
evaluation of the student's mastery of the performance objectives ♦ The 
jPSI formc^t presented here, however^ does place some constraints .0^ the type 
' ^. of mastery check. tha;b be used.' Recall that^hree of the PSI postulates 

yiere: ' 1) the cn:rgayizatipn of material t into several unit? that cov^r a rela- 
• ^i'^ « tiveiy s^all amoui(t of material; 2) frequent evaluation; and 3) immediate 
feedback* Thea^ three postulates emphas^ the use 'of mastery checks that 
; require relsrtiyely little time .for the student to complete aiad that .can be 
evaluated by .the tutor .in a relatively short amount^^£il 
' Si^oTi examinations usually fulfill these criteria without necessarily 
"6onf^ining''*he instructor to test ii^' only lower level cognitive skills. 

• • . . . • . ' \ ' 

Ideally, such quizzes af^ designed so that they can be tak^^in less than 
^ thirty minutes .and graded Ver^ quickly by a tutor. Tbey\usually contain 

fill-ins, true-false, short a3:iswer, short, essay multiple choice, or certain 
problem-solving types of test it^s. The instructor should construct at 
least three alternative quizzes for each uni|^f material* ^Jlecords are kept 
'dk each student that identify which ,f orm of a unit^ mastery check has been ^ ^ 

iadministeired to the student and whether or not he passed it. 

' ' . ■ ' ^ ' ' ' ' ' * 

Ixi addition to the mastery checks over each unit,* Keller, (1967: 6)^ 

\ ' \ ^ / » 

riBCOianends that review cnecks^be conducted^ periodically throughout the course* 

These reviews may be incorporated Ijito th6* mastery checks for particular 

i mits or^onay be admfeiistered sepa^fely.;^ These reviews serve as an add^ , , 
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. reinfdrcemen^ to the appropriate mastery of material already |overed. 
Rfevlewsr also promot? the longer retention ^of what was leajmed ^earlier. 
Reviews may be treated just like masteiy checks,^ requiring mastery before . 

A * . * 

* 1 

advancement to tjie next unit. — . - 

, / ' . VSl instructors differ with respect to defining the .term "mastery. " , 
Some T.equire a mastery check with no errors^ others" permit some' error,- such 
as 90% of a unit mastery quizj. Those who achieve the prescribed' mastery ^ 
level are permitted to. proceed to the next%Vttii^7 while those who fall short 

Ipu^t try again. The mastery I'evel selected by the instruct6r is bap^d upon 

^ the- objectives, necessities, ^d realities of the particular caurse, under 
considCTation. - o 

/' Pacing: .feicrtlSgi^ey feature of the Keller Plan format that we have adoplbed 
is the opposrtunitjr^Ibr the etuqent to work at. his own jjace in progressing 
through the units. In" reality, however, the. length of\the term, (semester-, 
{juarter, etc.) can establMh some time, constraints on the- student's ability 

. to t work at his own ijace.^ Keller (1967: 22-23) apparently operated his PSI 
cdurses under a rather iiberdj policy of administering "incon5)lete8" that 
extended the period of time ove? which .the student could complete |^1 of 
the uni13r<- Keller's technique is more consistent -^th the I^I postulate of 
self7pacing. We have found^^.It necessjary in our coxirses to require students 
to . coipplete the course b^ the end of the term or else withdraw from the^ 
course. "To peimit students to carry over into "^^^&om*se from the previous 




term strained our capacity to process the nurnljgr of stu denfe a needing ^to take 
* ^ the course. - ' * . ^ *® 

The^ Requirement that students complete the cdurse by the ' end of the • 
semester does tend to produce a higher mte of withdravials from the^ course 
than in* a conventional courae or in a course in which a liberal policy of 
, i incompletes is adopted. Many students are unable to exercise. the sWf- 

discipline necessary to ptffsue studies in a self-paped fopnat. ' Worlfi for a 



^ self-paced course is' of ^en the first to be set a^i^e v/tiile the student 

/ ■ _ / , ' V . • ^ , ' ^ • ^" 

concentrates on tne moue innaediate needs in^ his 'academic or personal life 
Various techniques &an be einployed to xeduc^ this witl^drawal rate. Some 
PSI instructor's Require ,tjie student iio, master at. least one 'or two units ' 
./v?ithin the first two weeis of the term, so that the student will get an 
early start- in the; course. Since the first unit or two ^e normally , easier - 

• units, this strategy also generates an early positive i^espbnse and" feeling ~ . ^ 
toward the PSI format. It is advisabl^e td' provide a recooaended schedxile 

for unit completion' to guide the'student .touard ^ siiccessf ul comple-^ion of 
the course. Instructors also may hold confei^ences vatb stud^ts^ ^hp r ^ 

' lagging bel^d in an effort .to determine whether any at^istance can be \ ^ 

rendered to^^e student. to stimula-^e progress^Jji the course. F i nal. 1^^, • ^ ' - 

* ^ ■ ' > \ ' ' - ^ ' . ' - 

additional times may be scheduled at^ which tutori^. sessions ^nd mastery ^ • 

checks are •.ev4ilalfle . - ' : . • - - c 

Self-pacing i3 a power ful' reinf or cer *in ti^e PSE course:^ it probably 

appears mb^e often than any otjier siagl^ feature in the positive evaluations 

- of the course by the students\ (Kulik,* Kuliki and Charmich^el, 1974: 380). . ^ 

For. most students, it is the first time that they have befen able to-determlne 
^ « *~ ^ • , ■ " 

* for themselves how tfiey best., can use their own time,, when they can study and 

f> • ' • c . ' ' ' ^ ^ ' ^ ; 

\ • ••'tak^ tests most ^fectively* ^ ^ ■ • 

1, » - ' ■ ' ' • , < . 

^ .Course jGrades : In a. PSI course th^t requires unit mastery, two general typea . 

of, course grading criteria can be identified (Wilson and Tolstif 1972: 103). 

The final course grade- can be based struct ly uporTthe amount of worlc c^ompleted- 
^ * • • ' , V/ ■ ' , • . ' r:^ 
In this scheme, ^ grade of *'A*' is obtained upon the successful mastery of a . 

i-' ^ « . . , > 

- * i*^' ,» tic 

given number of units. Lesser grades are based upon the completiqn, of 
successively ^ fewer numbers of units. (In a "credit"/"no credit** system, theri ^ ^ 
a certain number of units ^re specified in order to obtain' a "credit.-) 
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~* ' • ^ . . r ; ' » ^ 

The opposite of this technique is to r4<fuire all .stiidents to masteV success- 
1 . ' ^ ' ^ . 

fully the same number of units,^ and then to l?kse the cojirse grade on some ty^ 

* of graded (or "aredit"/"n6 credit^') qomprehensive final evaluation. • A 
^ . ♦ ♦ I ^ ^ . , ' ^ 

variation of this -latter techniqtjie is to u^e graded evaluations interspersed ; 

' > . ^' ' > ' ' ' ■ . • 

throughout tho, cour,se ( along wifh or everi^^Withoux a -final coi)5>rehensive 

eval\iation) just as jln a more conventional couif^e. .Everyone still - completes 
tiie same number of units,^but course grades are based upon the- graded 
evaluations, , ^ • . 

^ Y/e reject both schemes and have experimented with two other methods 
'^r^sented in Figure 2. In the self^-^paced 'unit mastery grading scheme , ^a 
^ student goes at l^s ovm pic.e and cl&n_ obt ain" up t o a g rade of "C" s trictly on 
the basis of the number o^units coEopleted^ that is,, vathout taldng a compre- 
hensive final: The number! of units requifed for the "C" is based on our 
--consideration of what consLtitutes the "minimum essentials" 'fq?.the "C" • - 
"stident to knojf. For a grad*e of "B" or "A" we feel that evidence of retention 
- I^d synthesis of the course material is a legitimate consideration.^ The 
coi33pr€hensive final permits a cheqlt for such evidence. 'Some element of risk 
races- the sttident vrfJti^uccesgfuliy masters the additional units, But fails 
•io achieve the specif ied criteria on th6 ccmprehensiYe final.- For example,- 
i;,he studeht.who comple-bes 15 units tut 'scores Ipvre? than 80? on his compre-. 
hensive final receives' a gra^e of "C". " In fact, a grade of "C" also^is 
assigned to the studeiit*who coifiplet^s al^, of .the -units bu-t^ scores less^ than 
70J Se-the comprehensive final.' In the ins-bructor-paced rion-'m astery gr^dijg - 
scheme , students co^lete the. same nmnber of Units but stre not required to 
"master" a munit before proceeding, to another uniti^ The instructor sets. ihe 
pace, for, th? complelioii of the units. The students may take two quizzes on -^ 
each unit. Only the higher bf the two quiz-, grades is counted toward the ' 
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Figure 2. Two PSI Grading Schemes 

■/ c • • . • 

• \* 

Self -paced Mastety Grading Scheme . 

Grade * Requirement , , 

.ET • Less than 11 unii'^'masW»^".^. - • i 

- ■ - ' ' ' •■>: • \ 

D 11 Unl?s mastered • 't'':^':^-' I 



C .1:3 units jnastered 

B ' • 15 Units mastered + 80? on 

comprehensive final 

A ' ^ 16 xinits mastered^ + 902 on 

9 



In3^ructor-Taced Non-Mastery Grading Scheme 



D ^ .60-69? 

C ^ ^ / "70-792 



comprehensive filial ' ^ j ^ 



Gradfe Requirement >' 1% 

E' :* ^ Below 60$ "'.^^ . ^ . ^' ^ / 



E \ ^ ^ V 80-89? • ^ /' 

A • • ' * 90? or above • ' 



Students complete all units in- the course. - 

The luiit quiz average contributes^owai^d- one Half of the coxirse grade. ^ 
Onljr^Jiif better of the /two quiz scores .is counted in the imit average. .-i^ 
The other half ot the ^course grade comes frcan the average pf three review 
.tests, ' . ' - * r '^i^^ 
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atudent's qviiz average. Half oC the studentjs grade consists of -his qulz^. 
.average and. half consists of the -stud:fent ' s. grade on three periodic review / • 
tests. Although this scheme deviates from- the PSI principles of self- 

f ^ i. * ' ' ' \ ^ 

paciDg tod .tinit-mastery, it has worked well in o\xr introductory :einpirical 
-political inquiry course. . • • - 

Role of th e Instructor ; The role of a PSI instructor is both demanding and^ 
different from that'- of a conventional teaching .role • The instructor is no 
longer primarily k disseminatoj^of inf^ormation and evaluator of student 
performances. He becomes a goal setter, test constructor, presQriber, ' 

motivator, ^resource^erson, administrator, tutor*-- a facilitator of 
* . . *' 

learning. He pafiitipates in the course as one of the tutors, and students 

may come to him or any of the other tutors. 

Keller (196S) does not utilize th6 course instructor as a tutor. ,He 

concedes the conseqilent labk of interiaction between students and instructor 

as an undesirable aspect of his system. The use of t^e instructor as^ one of 

• tHe tutors is a key feature for the most advantag^us implemeAtation of our 

format. If the 90urse is limited to- the number of^ students that we suggested 

earlier, then, the instructor can interact with more students more freqjjently 

than in a conventional classroom,.- r 

Xhe instructor also supervises the tutors and resolves any conflicts 

I which cannot be handled by IdEie tutors. Foremost among the concerns of 

. 

the instructor is the creation and maintenance -of positive conditions and 
consequences of student contact with coiirse' materials and tutdrs. Through 
ihdividulalized student contact, the instructor is able, to promote the' • 
..student's- tendency to inquire on his bvm and to fostfer in 'the student a 
favorable 'se^f-imagfe. of hijnself, his abilities, his cr.eati-(rity, and. his . 
uniqueness. For the/instructor, the amount .of time spent on the course 
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normally is equal to or greater than that spent'' on the conventioml course* 
However, in the 'PSI' course much more time is^ devoted to interactio^i with 
individual students and to the actual teaching of students through tKe ^ 
tutorial session, )Eor most instructors, this^is a very rewarding experience, ' 

EVALUATIOIjL^ipSI COURSES • - 

Efforts at evaluating th^' effectiveness., of PSI approaches and student 

Jo • >• ^ t , • 

receptivity to PSyhave beguif^tp appearognly recently in professional 
applications. The evaluation of. teachir^ techniques Us qixite susceptible to 
variety of methodological problems (see Caigpbeil and Stanely, 1963). ^^^'^ 

\ ^ V * - ' 

C9iiiparison between rSI and other teaching techniques is iiomplicatei further 
by. the' fact that the resource materisils u6ejj in the PSI courses frequently 
differ from. those Used in other Hechni^eS, JDespite these problems, however, 
enough evidence has been gathered to make at least some initial evaluations 
of BSI in general, and clo^e, variations of the Keller Plan in particular. 

We' are aware of two papers Vhfch ha^e .purveyed the literature *fol» ^ 
such evaluative research (Ku\ilc, }vt£lik,,and Ghannichael, 1974: 582; Reiser, 
1974). They eoncur iff reporting ^ con^^nsus that PSI students perform 
better on all types of -examinations/ ESI students also demonstrate longer 
retenl^n of ^terial than students in more conventional courses. Grade' 
distribution in PSI courses reveal a much .larger proportion of higher grades, 
despite controls for grading ci^iteria. Summarizing their review of research, 
James Kulik and his colleagues 'reported X\^XX\ oi the 15 evaluative research 
articles they examined confirmed the superior 'performance of PSi* students. 
The other four sl^udies found no statistically sigrlificant differences between 
-the Ke^er\Plan arid the control ^Qourse. Furthermore, of the- five studies 
judged to be especially methbiiblogically and analyticially §ound, all five 
reported the superiority of the Keller ^format (Kulik, Kulik> and CharmiShael, 
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20 



Not only do PSI ^courses demonstrate greater effectiveness in the 
cognitive development of students , but student responses In the affective 
•doma^^are very' positive toward the PSI approach.' Particularly fajbrable 
expressicds . are directed toward the self -pacing feature of PSI, the. self 7. 
detemlnation of study an^l test schedules, and the personalization a^spect * 

of 'fhteraction with the tutors and instructor (Kulik, Kulik, ^and Charmichael, 

' 1 ' ' ^ ' ' ' ^ ■ • 

1974) 380). The. comparison ^pf the PSI appi^oach to more convegAional tecaini- 

qufes invariably results in "^le more* favorable ranking of PSI by^ most student^. 

?SX has been viewed negatively by some educators b^^use of its 

- perceiyed reliance upon Skinnerian conditioning formulations. This attitud^, 

however, overlooks the conditioning nature of education, regardless of 'the 

type of instructional technique utilized. The, undesirable conditioning 

effects of our ed^cationaf^ystem have been the favorite subject for many 

authors of popu3:4r educational philosophy books. For example, One type of 

*))ehavipr likely jto be reinforced in a conventional lecture class is that of 

.*»passivity, the s'$iUdent becomes ^^ependent upon the instructor as the dispenser 

of information while' th^e student is the passive recipient, - \^ "believe that ; 
< " ft 

PSI can foster desirable intellectual ^and personal traits in students. 

students in a PSI format a\^e trained to take responsibility for their own 

I. t 
educational development: In PSI students are challenged to think, to reason, 

to articulate thoughts, and to master the understanding, of material much more 

iij^an is likely in a more conventional setting, "Tutorial sessions encourage 

. \ ^ 

in the students a Y/illingness*to seek but other opinioris and be less 
defensive about their own opinions. The tutorials also enhance the develop- 
^ment of higher cognitive skills, such as skills of aiialysis and evaluation. 
. Although we have touted highly the advanta^e^^d benefits of PSI, 



there are certain distinct disadvantages tli§t' diminish its ^'ff ectiveness 
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(see Wilson and Tolsti, 1972). Certain disadv^tages have been noted - 
throughout thid paper, for' example : cei^ai^i:^ constraints on the use of group 
instructional techniques; a tendency fo/ the number of students who dfop 
\the course to increase; 'and initial^udent apprehension ^bout the technique. 
iW PSI system is a complicated oxi^ with many^aoinponents that require proper 
implementation in-order to achieve mlaximum efi'eltiveness. Defects in any 
of these components can, short-circuit the system. For Example, the.qualit^' 



•of the tutors must remain hi';^'; the constraction of so many mastery checks, 
normally quizzes', creates problems^ of validity and reliability; the resource 
iriateTials assume a more important role than in the conventional course; the 
proper physical facilities are important;' ,-and the ^tudent/tutor 'ra'tio must 
not exceed a certain level. Some potent^^PSI instructors might 'regard the' 
gre^at amount of advanced 'preparation for such, a course as a 'distinct 
disadvantage. The preparation of multiple forms of numerous ■ mastery exams 
is timeconsum^.ng and may require supplies and resources, that are lacking. 

V • The'potential applications of PSI have not yet been defined. Some 
critics argue- that PSI is limited only to those course* which have a highly 
' organized subject matter- and which emphasize lower cognitive and psychomotoi; 
levels of .learning. We think, however, t^at the PSI postulates are relevant ' 
to ahv kind of> learning. Innovative and industrio'us instructors .G.an de^^6lop 
PSI formats for a wide variety of .courses, ranging from statistics ^ff" 
American government to political philosophy,- from,. whence. indidivualized 
instruction originated in the forin of Socratic diaj.ogues. . \ ; 
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